Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist

نویسندگان

چکیده

In a regular full exponential family, the maximum likelihood estimator (MLE) need not exist in traditional sense. However, MLE may completion of family. Existing algorithms for finding solve many linear programs; they are slow small problems and too large problems. We provide new, fast, scalable methodology This is based on conventional computations which come close, sense, to These construct maximizing sequence canonical parameter values goes uphill function until meet convergence criteria. Nonexistence this context results from degeneracy statistic boundary its support. There correspondance between null eigenvectors Fisher information matrix. Convergence along follows cumulant generating (CGF) sequence, conditions given. allows construction necessarily one-sided confidence intervals mean value parameters when exists completion. demonstrate our three examples main text additional an accompanying technical report. show that provides statistical inference much faster than existing techniques.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Targeted Maximum Likelihood Estimation using Exponential Families.

Targeted maximum likelihood estimation (TMLE) is a general method for estimating parameters in semiparametric and nonparametric models. The key step in any TMLE implementation is constructing a sequence of least-favorable parametric models for the parameter of interest. This has been done for a variety of parameters arising in causal inference problems, by augmenting standard regression models ...

متن کامل

Three Papers on Maximum Likelihood in Exponential Families

General methods for obtaining maximum likelihood estimates in exponential families are demonstrated using a constrained autologistic model for estimating relatedness from DNA fingerprint data. The novel features are the use of constrained optimization and two new algorithms for maximum likelihood estimation. The first, the "phase I" algorithm determines the support of the MLE in the closure of ...

متن کامل

Likelihood Inference in Exponential Families and Directions of Recession

When in a full exponential family the maximum likelihood estimate (MLE) does not exist, the MLE may exist in the Barndorff-Nielsen completion of the family. We propose a practical algorithm for finding the MLE in the completion based on repeated linear programming using the R contributed package rcdd and illustrate it with two generalized linear model examples. When the MLE for the null hypothe...

متن کامل

Lecture 22: Maximum Likelihood Estimator

In the first part of this lecture, we will deal with the consistency and asymptotic distribution of maximum likelihood estimator. The second part of the lecture focuses on signal estimation/tracking. An estimator is said to be consistent if it converges to the quantity being estimated. This section speaks about the consistency of MLE and conditions under which MLE is consistent.

متن کامل

Computationally Efficient Gaussian Maximum Likelihood Methods for Vector ARFIMA Models

In this paper, we discuss two distinct multivariate time series models that extend the univariate ARFIMA model. We describe algorithms for computing the covariances of each model, for computing the quadratic form and approximating the determinant for maximum likelihood estimation, and for simulating from each model. We compare the speed and accuracy of each algorithm to existing methods and mea...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronic Journal of Statistics

سال: 2021

ISSN: ['1935-7524']

DOI: https://doi.org/10.1214/21-ejs1815